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AMENDMENTS TO THE CLAIMS 

This following is a listing of claims pending in the instant application: 

CLAIMS 

1. (Currently Amended) A method for unifying speech user interface and graphic user 
interface commands, comprising the steps of: 

receiving grammar specifying a syntax of at least one speech command and 
having semantic information; [[and]] 

processing the grammar to extract the semantic information for use with both a 
graphical user interface and a speech user interfacerr.il ; and 

receiving a user input to select at least one component in the graphical user 
interface during a navigation of the graphical user interface; 

audibly receiving the at least one speech command associated with the at least 
one component from the speech user interface; 

visually presenting the at least one speech command in a visual prompt of the 
graphical user interface responsive to the step of audibly receiving; and 

building a corresponding speech command for a plurality of speech commands 
associated with a plurality of components. 

2. (Currently Amended) The method of claim 1, wherein the method further comprises 
the step of generating graphical user interface elements corresponding to the semantic 
information in the grammar and wherein the corresponding speech command is a single 
instance of a plurality of speech commands associated with a selection of one or more 
components of the graphical user interface during the navigation of the graphical user 
interface. . 

3. (Original) The method of claim 1, wherein the method further comprises the step of 
generating speech grammar from the grammar and semantic information. 
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4. (Original) The method of claim 1, wherein the method further uses the grammar and 
the semantic information to generate visual graphical user interface elements required 
to implement a set of commands contained in the grammar. 

5. (Original) The method of claim 1, wherein the step of processing further comprises 
processing the semantic information to generate semantic directives used for parsing 
the grammar between the graphical user interface and the speech user interface. 

6. (Currently Amended) A method for unifying speech user interface and graphic user 
interface commands, comprising the steps of: 

receiving user entered text via a graphical user interface; 

processing the user entered text via the graphical user interface; 

monitoring the user entered text and adding input context associated with a 
selection of at least one component in the graphical user interface to the user entered 
text; [[and]] 

updating a speech recognizer with the user entered text and semantic 
information^.]]; 

audibly receiving at least one speech command associated with the selection of 
the at least one component from the speech user interface; 

visually presenting the at least one speech command in a visual prompt of the 
graphical user interface responsive to the step of audibly receiving; and 

building a corresponding speech command for a plurality of speech commands 
associated with a plurality of components, 

wherein the corresponding speech command is a single instance of a plurality of 
speech commands associated with a selection of one or more components of the 
graphical user interface during the navigation of the graphical user interface. 
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7. (Original) The method of claim 6, wherein the step of updating the speech 
recognizer comprises the step of accepting new text information and input context to 
augment and update a speech grammar and recognition vocabulary of the speech 
recognizer. 

8. (Original) The method of claim 6, wherein the method further comprises the step of 
updating the graphical user interface. 

9. (Original) The method of claim 8, wherein the step of updating the graphical user 
interface comprises the steps of updating graphical user interface directives and 
elements to maintain the graphical user interface unified with the speech grammar. 

10. (Original) The method of claim 6, wherein the method further comprises forming a 
window for displaying a speech interface command as it is being built using the 
graphical user interface. 
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11. (Currently Amended) A system having a unified speech user interface and 
graphical user interface, comprising: 

a display for providing an output for graphic user interface elements; and 
a processor coupled to the display, the processor programmed to: 

receive grammar specifying a syntax of at least one speech command and 
having semantic information; [[and]] 

process the grammar to extract the semantic information for use with both 
a graphical user interface and a speech user interface^.]]: 

receive a user input to select at least one component in the graphical user 
interface during a navigation of the graphical user interface: 

audibly receive the at least one speech command associated with the at 
least one component from the speech user interface: 

visually present the at least one speech command in a visual prompt of 
the graphical user interface responsive to the step of audibly receiving: and 

build a corresponding speech command for a plurality of speech 
commands associated with a plurality of components. 

12. (Currently Amended) The system of claim 11, wherein the processor is further 
programmed to generate graphical user interface elements corresponding to the 
semantic information in the gramma r and wherein the corresponding speech command 
is a single instance of a plurality of speech commands associated with a selection of 
one or more components of the graphical user interface during the navigation of the 
graphical user interface. . 

13. (Original) The system of claim 1 1 , wherein the processor is further programmed to 
generate speech grammar from the grammar and semantic information. 

14. (Original) The system of claim 1 1 , wherein the processor is further programmed to 
use the grammar and the semantic information to generate visual graphical user 
interface elements required to implement a set of commands contained in the grammar. 
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15. (Original) The system of claim 1 1 , wherein the processor is further programmed to 
process the semantic information to generate semantic directives used for parsing the 
grammar between the graphical user interface and the speech user interface. 

16. (Currently Amended) A system having a unified speech user interface and 
graphical user interface, comprising: 

a display for providing an output for graphic user interface elements; and 
a processor coupled to the display, the processor programmed to: 
receive user entered text via a graphical user interface; 
process the user entered text via the graphical user interface; 
monitor the user entered text and adding input context associated with a 
selection of at least one component in the graphical user interface to the user entered 
text; [[and]] 

update a speech recognizer with the user entered text and semantic 
information^.]]; 

audibly receive at least one speech command associated with the 
selection of at least one component from the speech user interface; 

visually present the at least one speech command in a visual prompt of 
the graphical user interface responsive to the step of audibly receiving; and 

build a corresponding speech command for a plurality of speech 
commands associated with a plurality of components, 

wherein the corresponding speech command is a single instance of a 
plurality of speech commands associated with a selection of one or more components 
of the graphical user interface during the navigation of the graphical user interface. 

17. (Original) The system of claim 16, wherein the processor is further programmed to 
update the speech recognizer by accepting new text information and input context to 
augment and update a speech grammar and recognition vocabulary of the speech 
recognizer. 
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18. (Original) The system of claim 16, wherein the processor is further programmed to 
update the graphical user interface by updating graphical user interface directives and 
graphical user elements to maintain the graphical user interface unified with the speech 
grammar of the speech user interface. 

19. (Original) The system of claim 16, wherein the processor is further programmed to 
form a window in the graphical user interface enabling the display of a speech interface 
command as a user constructs the speech interface command. 

20. (Currently Amended) A machine readable storage, having stored thereon a 
computer program having a plurality of code sections executable by a machine for 
causing the machine to perform the steps of: 

receiving grammar specifying a syntax of at least one speech command and 
having semantic information; [[and]] 

processing the grammar to extract the semantic information for use with both a 
graphical user interface and a speech user interface^.]] ; 

receiving a user input to select at least one component in the graphical user 
interface during a navigation of the graphical user interface; 

audibly receiving the at least one speech command associated with the at least 
one component from the speech user interface; 

visually presenting the at least one speech command in a visual prompt of the 
graphical user interface responsive to the step of audibly receiving; and 

building a corresponding speech command for a plurality of speech commands 
associated with a plurality of components, 

wherein the corresponding speech command is a single instance of a plurality of 
speech commands associated with a selection of one or more components of the 
graphical user interface during the navigation of the graphical user interface. 
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21. (Currently Amended) A machine readable storage, having stored thereon a 
computer program having a plurality of code sections executable by a machine for 
causing the machine to perform the steps of: 

receiving user entered text via a graphical user interface; 

processing the user entered text via the graphical user interface; 

monitoring the user entered text and adding input context a ssociated with a 
selection of at least one component in the graphical user interface to the user entered 
text; [[and]] 

updating a speech recognizer with the user entered text and semantic 
information^.]]; 

audibly receiving at least one speech command associated with the selection of 
the at least one component from the speech user interface; 

visually presenting the at least one speech command in a visual prompt of the 
graphical user interface responsive to the step of audibly receiving; and 

building a corresponding speech command for a plurality of speech commands 
associated with a plurality of components, 

wherein the corresponding speech command is a single instance of a plurality of 
speech commands associated with a selection of one or more components of the 
graphical user interface during the navigation of the graphical user interface. 
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